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Two Pinning Models with Markov 

disorder 

Abstract: Disordered pinning models deal with the (de)localization tran- 
sition of a polymer in interaction with a heterogeneous interface. In this 
paper, we focus on two models where the inhomogeneities at the interface 
are not independent but given by an irreducible Markov chain on a finite 
state space. In the first model, using Markov renewal tools, we give an 
expression for the annealed critical curve in terms of a Perron-Frobenius 
eigenvalue, and provide examples where exact computations are possible. 
In the second model, the transition matrix vary with the size of the system 
so that, roughly speaking, disorder is more and more correlated. In this case 
wc are able to give the limit of the averaged quenched free energy, therefore 
providing the full phase diagram picture, and the number of critical points 
is related to the number of states of the Markov chain. We also mention 
that the question of pinning in correlated disorder appears in the context 
of DNA dcnaturation. 
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1. Introduction 

Among statistical mechanics systems, disordered pinning models have received 
much attention in the last past years. This class of models deals with the localiza- 
tion/dclocalization transition of a polymer interacting with an inhomogeneous 
interface, and whereas the homogeneous version is fully solvable, some questions 
on the disordered case were answered only recently. This paper deals with two 
pinning models with Markov disorder, and is organized as follows: in a first part 
we will recall notations and general facts on the model, and give an overview of 
results dealing with the critical curve of the phase diagram (for a more detailed 
account on pinning models, the reader can refer to the monographs [10], [8, Ch. 
7,11] and the survey papers [11], [18]). We then introduce the two models, which 
will be developed in one section each. 

1.1. General model and general facts 



The model we use is the renewal pinning model, that we recall here. Suppose 
that the interface is modelled by the half line [0, -l-oo) and the points of contact 
between the polymer and the interface by a discrete renewal process r = (t„)„>o 
where tq := and K{n) := P{ti = n) = L{n)n~^^^'^^ (L : N i-> (0,+oo) being 
a slowly varying function and a > 0) is the law of interarrival times. Without 
loss of generality, we assume r is recurrent (X]n>i -^l"-) ~ ^^^^ denote 

by 5n the indicator function of the event {n € r} := 'Jk>o{Tk = n}. 

1 
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Let now Lj — (aj„)„>o be a sequence of centered random variables, indepen- 
dent of T, standing for the inhomogeneities on the interface. We will use the 
notation E (resp. E) for integration with respect to P, the law of w (resp. P, 
the law of r). 

For a typical realization of w, and parameters ft, G M, /3 > 0, we define the 
hamiltonian at size N as 

N 

HN,i3,h,u{T) = ^(/3a;„ + h)5n 

n=l 

and the corresponding polymer law by 
where 

is called the partition function. We call free energy at size N, the (random) 
function ^ 

Fat ft) ^ — logZN.p.h.ui- 

If the sequence uj is stationary, ergodic and integrable, then one can prove 
by subadditive arguments that there exists a deterministic quantity i^(/3, ft.) > 
(the infinite size quenched free energy) such that for all parameters (/3,ft), 
lim7v->+oo Fj^iP, ft) — F{/3, ft) in the L^{uj) and w-almost surely (see [10, Theo- 
rem 4.6]). Then let us define the localized phase C = {(/?, ft), F{(3, ft) > 0} and 
the delocalized phase 2? = {(/3, h),F{(i, ft) = 0}. One can see why by looking at 
the partial derivative of F with respect to ft: using convexity arguments, we can 
write dhF{j3,h) = Iiirn dhF^i/S, h) = limN^+ac. EN,f3,h{{i/N)Y,^=iSn) 
which is the limiting contact density under the polymer law. Still using the con- 
vexity of F{(3, ft), one can prove the existence of a concave curve (called critical 
curve) (3 i— > ftc(/3) G [— oo,0] such that for all /3 > 0, 

{f3,h)eC ^ ft > ftc(/3). 



1.2. The critical curve: State of the art 

Let us look at the results available on the critical curve. We already know 
from the homogeneous pinning model that ftc(O) — (see [10, Ch.2]). Then 
one can prove that hc{P) < 0, and with a little more work, provided disorder is 
nondegenerate, that ftc(/3) < if /? > 0: this means that disorder has a localizing 
effect (see [10, Proposition 5.1 and Theorem 5.2]). 

Before giving a lower bound, we assume that uj = (w„)„>o is a sequence of 
independent and identically distributed random variables, such that the moment 
generating function A(/3) := E{e^'^") is finite at least on an open interval [0,c). 
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This allows us to give the following lower bound on the critical curve: for all 

/3e [o,c), 

hc{P)>K{P) :=-logA(/3). 
This a direct consequence of the following observation: by Jensen's inequality, 

EFAr(/3, h) < h) := ^ \og^ZN,p,Ku (1) 

(note that this inequality is general: we do not require any independence as- 
sumption at this point). The quantity Z*^ ^ ,^ := EZat^^^^^^ is called annealed 
partition function. If we now use the fact that the a;„'s are i.i.d., one gets 



N 

Z%,(s,h = Eiexpi{h + log Am Sn ] Sn 



so that in this case the annealed free energy is nothing but the homogeneous 
free energy (/3 = 0) with parameter h shifted by logA(/3). Since the critical 
point of the homogeneous model is 0, the critical point of the annealed model 
is /i« (/?) = - log A(/3). 

The question of whether the annealed critical curve and the quenched 
critical curve he coincide (as well as the related question of equality of critical 
exponents) has been the topic of many papers. Several authors ([1, 17, 14, 6]) 
proved consecutively, with different methods, that if a is in (0, i), then the 
equality hc{f3) = h'^iP) holds for small enough /3. The same is true for a = ^ 
provided J2n>i nLin)'^ ^ +0O, and more recently the result has been proved for 
a = 0, the equality being true for all values of /3 in this case (see [3]). If a > 1/2 
or if a = 1/2 but under some conditions on L ( for instance, if L{oo) = 0, or L 
is a constant) , then disorder is relevant for all (3, meaning that hc{(3) > h'^{P) 
(see [2], [9], [12]). The fact that the critical value of a is 1/2 is in accordance 
with a heuristic called Harris criterion (see [18, p. 145-146] or [10, p. 116-118] for 
example) . 

As pointed out earlier, these results hold in the case of i.i.d. disorder. In [16], 
the author considered a model with locally correlated disorder. In this model 
the LUnS constitute a gaussian moving average of finite order (meaning that 
Cov(wo, uJn) = as soon as ]n) > for some fixed q € N*). The annealed system 
is then related to a pinning model for a particular Markov renewal process, and 
the annealed critical curve is given in terms of a Perron-Frobenius eigenvalue. 
The following high-temperature behaviour is also proved: 

where 

n>l 

The question of disorder irrelevance is ongoing work. 
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1.3. Two models with markov disorder 

In this paper we continue to investigate the case of correlated disorder by study- 
ing the case when uj is given by the functional of a homogeneous Markov chain 
with finite state space. The question of a disordered pinning model with Markov 
dependence was raised in [8, p. 204] (in the context of copolymers near a linear 
selective interface as well). We will look at two different models. Motivations 
will be discussed in the next subsection. 

1.3.1. Model A. 

Let X = (Xn)n>o be a homogeneous irreducible Markov chain on a finite state 
space S. Its transition matrix will be denoted by Q and its initial distribution is 
its invariant distribution /ig. Note that in this case, X is ergodic. The disorder 
sequence will be given by 

UJn = fiXn) 

where / : E H> M is such that E(a;o)(= ^o{f{Xo))) — 0. For this first model we 
will show that the annealed free energy satisfies an implicit equation and that 
the annealed critical curve can be expressed as the Perron-Frobenius eigenvalue 
of a positive matrix which depends both on the kernel K and the matrix Q. 
Moreover, we will sec along the proof that the annealed system at the annealed 
critical curve is equivalent to the pinning of a Markov renewal process. We men- 
tion that such tools were previously used in the study of pinning with periodic 
inhomogeneities (see [5]; indeed, our model includes periodic sequences). As no- 
ticed in the previous subsection, the annealed critical curve provides a lower 
bound on /ic(/3), but the issue of disorder (ir)relevance is open. 

1.3.2. Model B. 

In model B, the disorder sequence will be a Markov chain taking values in 
{ — I, +1}, with transition matrix 

where 7 G (0, 1), and starting at the invariant distribution fi ~ (1/2, 1/2). Its 
law will be denoted by p(^) , the important difference with model A being that 
this law now depends on the size N of the system. We will give a motivation for 
introducing such a model at the end of the following section: at this point, we 
only notice that the disorder sequence for a system of size consists roughly 
of strips of —1 and -|-l's, the size of them being of order N^~'' . In this model 
we will determine the limit as N tends to infinity of the (averaged) free energy 
E(^'(F;v(/?, h)), in terms of the free energy of the homogeneous model. 
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1.4- Motivations. The link with DNA denaturation 

One of the applications of pinning models is the study of DNA denaturation 
(or melting), that is the process by which the two strands of a DNA molecule 
separate as the temperature increases. The two strands are constituted of com- 
plementary sequences of nucleotides (A with T, and C with G) and are pinned 
together by hydrogen bonds, the strength of which depends on the pair of nu- 
cleotides (AT bonds are weaker than CG ones). As the temperature increases, 
entropy wins over energy, and the two strands separate by forming loops (first 
at AT regions). In our context , the renewal points (t„)„>o stands for the sites 
where the two strands arc pinned together and K{-) is the law for the length 
of loops, whereas lu stands for the nucleotide sequence (and therefore should 
be a binary sequence) . With this interpretation of the model, the phase tran- 
sition corresponds to DNA denaturation. Furthermore, it has been shown that 
DNA sequences display long-range correlations (see [15] and [7] for instance, and 
[4], [13] for models where this fact is taken into account ). For the link between 
the pinning model and the Poland-Scheraga model, see [10, Section 1.4] and 
references therein. 

2. Model A. The annealed critical curve 

Before we state our result, we need further notations. Let M{t, /?, h) be the E x S 
nonnegative matrix defined by 

M{t, p, h){x, y) = K{t)Q\x, y)ePf^y^+^ (2) 

and for all 6 > 0, 

A(6,/3,/i) ^M(i,^,/i)cxp(-6t). (3) 

t>i 

Since Q is irreducible, for all x and y there exists t such that K{t)Q*{x, y) > 0, 
so A(b, P, h) is a positive matrix, and its Perron-Frobenius eigenvalue will be 
denoted by A(6, /3, h). Henceforth wc will write A(/3) for A(0, /?, 0). 

2. 1 . Statement of results 

For model A our result is; 

Theorem 2.1. For all h and nonnegative (3, 

llogEZ^,^,,'^^°°F°(/?,/i) >0. 

where F'^(/3,h) is solution of the implicit equation 

X{F-{/3,h),(3,h) = l (4) 
if X{0, /3,h) > 1 and F°'{(3,h) ~ otherwise. The annealed critical curve is 
h'^M := sup{/i|f^"(/?,/i) = 0} = -logA(/3) 
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Notice that (4) is the analog of the imphcit equation for the annealed free 
energy in the i.i.d. case (which sums up to a homogeneous free energy): 

^ K{n) exp(-F"(/3, h)n) = exp(-/i - log A(/3)). 

n>l 



2.2. Proof 

Proof. Wc start by decomposing the quenched partition function according to 
the number of renewal points before N: 

N k 

fc=l O=:io<tl<... i=l 
■ ■■<tk-i<tk-=N 

Averaging on X gives for the annealed partition function: 

N 



^kh+P{f{xi) + ...+f(xk)) X 



k—1 0—:tQ<ti<... XQ^xi, x/^tES 

...<tfc_l<tfc:=JV 

X M0(-^0)Q*^ (XO, Xl)Q*'-'' (Xl, X2) . . . Q*"-*"-' {Xk-l,Xk) 

X K{h)K{t2-ti)...K{tk-tk-i). 
Recall notation (2) and notice that: 

TV k 

E^AT./j./i = ^Q{xQ)Yi_M{u-ti-i,i3,h){xt-i,xt). 

k=l 0=:ta<ti<... xo,xi i^i 
...<tk-i<tk-=N ■■■■Xk&T, 

Wc will denote by £,{b, /3, h) an eigenvector (defined up to a scalar, with positive 
entries) associated to A(6, /3, h), the Perron- Frobenius eigenvalue of the positive 
matrix A{b,l3,h) defined in (3). The dependence on h of these quantities is 
simple: we have A(6, /3, h) = e''A(6, /?, 0) and since ^ is defined up to a scalar, the 
h in ^(6, /3, /i) is irrelevant, so we will simply write ^{b,/3). From the definition 
of A and ^, we have for all & > and all x G S, 

^ A{b,l3,h){x,y)ab,f3){y) ^ 
\{b,P,h)iiP,P){x) 

which also writes 

V V M{t,P,h){x,y)e-''ab,P){y) ^ 

Kb,P,h)iih,P){x) ■ ^ ^ 

Suppose first that A(0,/3, /i) > 1. Since X{F,P,h) is a continuous (in fact, 
smooth), strictly decreasing function of F, such that X{F, f3, h) tends to as F 
tends to +oo, there exists F"' = i^"(/3, h) > such that XiF", /3, h) = 1. Let 

p{x,y,t) :=M(<)(x,2/)e-^°*^ 
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(we omit /3 and h for a moment) so that for all x E T,, 

^^p(x,j/,t) = l. (6) 

t>l yeE 

What equation (6) means is precisely that p is the kernel of a Markov renewal 
process (also called semi-Markov kernel): let r be a process on the integers, 
defined by 

n 

rn=Y.T, (7) 

fe=i 

where the interarrival times are given by the following Markov chain in S x N 
(the value of To is not important): 

P((Xo,To) = (xo,<)) = Mo(-To)5o(i), 
P((X„+i,T„+i) = (2/,i)|(X„,T„) = {x,3))^p{x,y,t). 

The process X is called the modulating chain of the Markov renewal process t. 
From (6) and (5), one obtains 

k=l O=:to<ti<... xo.xi....,XkeT.^^ 
...<tfc_l<tfc:=Af 



k 

X 



Notice that 

N k 



P(iVGT) = ^ Y ^io{xo)\{p{xi_l,X^,U-U^l), 



k—1 0—:tQ<ti<... XQ,x\,...,Xk£T^ i—1 
...<tk-i<tk:=N 



SO we have 



U < c:— mm , , < „ .. — < max —— =: C. 

x,yGS ^(y) - e^°^P(A^ (^t) - x,yeS ^{y) 

Since P(A^ & t) < 1, it is sufficient to prove that liminfAr_>+oo P(Af G t) > 
0. Let X be an element of E and (Tf^)n>o the successive return times of the 
Markov renewal process r where the underlying Markov chain is in the state 
X. Then is a (delayed) renewal process with finite mean inter-arrival time 
= X^yGS ™y '^°a{x) '^^erc niy :— E{Ti\Xo = y). Thus we have by the renewal 
theorem: 

P{N Et)> P{N e r"^) ^ — > 0. 
We are left with the case A(0, /3, h) < 1. Note that in any case, 
ZN,p,h,x > exp(/i + PfiXN))KiN) 
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SO liminfAT^oo ;^ logE^Ar,/3.h > 0. Suppose that A(0,/3,/i) = 1. Then one can 
repeat the same arguments as m the case A(0, /?, h) > 1, except F° = 0, and one 
finds EZN,i3,h <Cx P{N G r), so Hirn^ jflogEZN.pM = 0. If A(0,/3,/i) < 1, 
we also take = in (6) and p is now a sub-probabihty. Again, we have 
WlZN,f).h < C X P(A^ G r), where r is a transient Markov renewal process, and 
limAT^+oo jf logEZN,i3,h = 0. 

We have now proven the first point of the theorem. The second point is an 
immediate consequence: 

Fa=Fa{l5,h) >Q^\{Q,l3,h) > 1 
<^ e''A(0,/3,0) > 1 
^h> - log A(0, /3, 0) = - log A(/3) 

which means that 

/i^(/?) = -logA(/3). 

□ 

2. 3. Examples 

2.3.1. Moving averages 

Let e = (en)nez be a sequence of i.i.d. random variables with values in a fi- 
nite state space A. Let (ao,--- ,ag) be in and define w a g-th order 
moving average by w„ = ao£n + + • • ■ + aqSn-q- These locally de- 
pendent variables are in the scope of this paper since a;„ = /(X„) where 
= i^n-q, ' • ' 7 £n) IS indeed a Markov chain on S := and / is a function 

on S: /(a;o,.Ti, ■■ ■ ,Xq) = a^Xq + aiXq-i H h aq.To. 

Take for instance g = 1, A = {-1, +1}, and P(e„ = 1) = P(e„ = -1) = 1/2. 
Then we have to consider a markov chain in 

= {(-1, -1), (-1, +1), (+1, -1), (+1, +1)} 



/ 1/2 1/2 \ 

1/2 1/2 

1/2 1/2 

\ 1/2 1/2 j 



I 1/4 1/4 1/4 1/4 \ 

1/4 1/4 1/4 1/4 

1/4 1/4 1/4 1/4 

\ 1/4 1/4 1/4 1/4 / 



with transition matrix 



Q = 



Since for all t > 2, 
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the matrix j4(0,/3,0) can be easily computed, and its Perron-Frobenius eigen- 
value turns out to be 

A(/?) ^ cosh(ao/3) cosh(ai/?) f 1 + K{1){ 7^ m ^ W ^ m " ' 

\ cosn(aop) cosh(aip) / 

One can check that we find the same result by using the method suggested in 
[16] for g = 1. 



2.3.2. A chain in {-1,+!} 



We consider a particular case where the annealed critical curve can be computed. 
Suppose that a; is a Markov chain consisting of +1 and — I's, with transition 
matrix (0 < e < 1) 

e 1 - e 
1 - e e 

and invariant probability measure ^ = ^-i+s+i ^ jf g — g, then the sequence is 
periodic (see [5]) whereas e = 1/2 is the i.i.d. setting. The eigenvalues of Q are 
1 and 2e — 1 with respective eigenvectors (1,1) and (1, —1), so for all t > 1, 

^* _ 1 M + (2e - 1)* 1 - (2e - 1)* \ , 
^ - 2\l-{2e-lY l + (2e-l)* ) 

and 

1^ e-^(l-p(e)) e^p(e) 

where p{e) := X]t>i ^^^^2~^^ • Then, we find by computing the Perron- 
Frobenius eigenvalue of A: 



h''^{(3) = - log (^{e) cosh(/3) + y^p(e)2cosh2(/3) -2p(e) -M 
and one can check the consistency with the periodic and i.i.d. cases 



3. Model B. The phase diagram 

Consider the example of the Markov chain in {—1, -1-1} given above, and notice 
that /i" is increasing in e if e is in [1/2, 1] . By making e tend to 1 (i.e. increasing 
correlations of disorder), we make h'^iP) tend to — /3, which is the minimum of all 
possible values for the critical curve (simply because (3u! < (3). Of course we do 
not want to make e equal to 1, which would lead to a homogeneous model with 
reward equal to —1 or 1 with probability one half. That is why we introduce 
model B, where e tends to 1 (while staying positive, so that asymptotically there 
is the same number of —1 and -t-l's) as the size of the system goes to -l-cxo, as a 
caricature of a disordered model with strong correlations. 




Fig 1 . A picture of the phase diagram at f) fixed, for model B: f) and — /3 are the points where 
F{fi,-) is not analytic (this is a direct consequence of the non-analiticity of the homogeneous 
free energy at h = 0, see [10]). 



3.1. Statement of the result 

In the following, we will denote by F[h) := F(0, h) the free energy associated 
to a polymer pinned at a homogeneous interface with reward h. In this section 
we will prove the following convergence: 



Theorem 3.1. For all (3 >Q, he 



if h<-l3 



E(^)F^(/3, h) F{P, h) := { if -P<h<p 



In this model, we therefore have the full phase diagram picture (see figure 
3.1). What the previous statement says is that there is one delocalized phase 
and two localized phases. For h < — /3, the whole interface is repulsive and it is 
clear that the free energy is zero. If ft, > — /3 but h < /3, then half of the strips are 
attractive (with reward h + (3), the other half being repulsive {h ~ P). Since the 
strips are large enough, the polymer can be pinned at those attractive strips, so 
the resulting free energy is half of the free energy associated to the homogeneous 
reward h + (3. li h > f3, the whole interface is attractive, and the free energy 
should be the mean of the free energy received on (+l)-strips {F{P + h)) and 
the one received on (— l)-strips {F{f3 — h)). Hence it is a phase diagram with 
two phase transitions, in the sense that there are two points, —(3 and /3, where 
the free energy function is not analytic. 
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Before we give the sketch of the proof, we define the following random vari- 
ables, related to disorder: 

Li = mi{n > l,a;„ ^ ujq} - 1 



Lk+i = inf{n > Lfe,w„ ^ - 1 

which are the cndpoints of the ±1 strips. 

the lengths of the strips, and 

Bn :== sup{A: >0,Lk< N} 

the number of complete strips between and N. 

First we will prove that the theorem is true for a modified version of the 
model, where the polymer is constrained to visit the endpoints of each strip: its 
partition function writes 

/ N Sjv \ 

/- n , T \ e \ /II e \ c 

N 



E cxp(^(/3t^„ + /i)5„)(n'5Lj^. 

\ n. 

and its free energy. 



i=l 



1 

N 

Then we will show that one can safely pin the polymer at those endpoints: for 
each endpoint, the cost is at most polynomial in and what make things work 
is that the number of endpoints is of order A^^"''' ^ A^. 



3.2. Proof 

In this section, ^ is the partition function of a polymer pinned at and N, 
in a homogeneous environment with reward h. First we prove: 

Lemma 3.1. E(^)F^(^, h) F{p, h). 

Proof. By Markov property we may write: 

f^" c \ c 

We will use the following estimates of the partition function for the homogeneous 
pinning (see [10], we do not give the sharpest versions, but these will be enough 
for our purpose). If e > 0, there exists c(e) > such that for alH > 1, 
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If e < 0, there exists C2(e) > such that for all / > 1, 

C2{e)K{l) < Zl, < 1 

and for e = 0, 

l>PGer) = Z,o>| if a e (0,1] 

(with c > but arbitrarily small). 

Let's begin with the case h G (— /?, /3). If we apply the estimates above to the 
decomposition in (9), we get: (we write h = — /? + e) 

N 

Z%,j,^^<cxp{F{e)J2M..„=i}) 

n=l 

and 

JV Bjv 

Z'N,p,n > c(e)^"/2exp(^^(e)5]l{^„.i}) x c^ief-^/'i J] ^r') 

n=l i—l,ujL^_^— — l 

with some power 6* > 0. In the last product, each factor is larger than N^^ . 
Taking the log and dividing by A'^, we obtain: 

^ < ^ log Zjv,^^,, -^1^ l{-„=i}) < 

n=l 

The result follows by taking the expectation with respect to p(^) and letting N 
go to infinity, since 

N 

E^Bat = ^P^^)(^„ ^ ^„+i) = NxN-^ « N. 
11=1 

The proof is the same for h > /3. □ 

We now want to prove that E(^)Fjv(/3, /i) and E'^^^F^(/3, ft,) have the same 
limit. Since, obviously, 

we have 

liminfE(^)FAr(/3,/i) > limE(^)i^^(/3, ft) = F{l3,h) 
so the only thing we need to prove is 

Lemma 3.2. limsupE(^)FAr(/?, ft) < limE(^)F^(/3, ft)(= F{P,h)) 



Poisat/Pinning with Markov disorder 



13 



Proof. In this proof wc use the following notation: 

K{n) = Y,K{l) 

l>n 

with the fact that K{n) ^ nK{n). First we prove that the cost of pinning the 
polymer at one arbitrary point n S {!,..., A^}, for /3 and h fixed, is at most 
polynomial in . If n is not a contact point, then we can decompose the partition 
on the last point visited before n (say n — a) and the first point visited after n 
(say n + 6). One obtains 

i;(exp(i/jv)<^jv(l-<5„)) 

n N—n 

= X! X] ^^-a,liM,uje'^'^"+'''^'^K{a + b)ZN_n-b,i3,h,e-^+huj 

a=l b=l 

n N — n 

= E E ^n-a,/J,/.A'(a)e^""+''^"i^(6)e^""+^+''Z^,_„^,,^,;,,e„+.,C(a,&,n) 

a=l 6=1 

where {9u!)n = Wn+i and 

with some positive c,. Therefore, we have 

Zn^PM < (1 + CN^+''+')E{cMHN)SNSn). 
Repeating the operation times, we get 

Zn,0M < (1 + C7V2+a+.)S„ ^ ^^^^^^^ 

taking the log, dividing by N, and averaging over w (again, we use 

N-^^^), we get the result. □ 

3.3. A remark on the general case 

The result can actually be generalized to an arbitrary finite number of states. 
We give it here for completeness. However, the generalization of the proof given 
for two-state Markov chains is quite straightforward, so we have chosen not to 
reproduce it here. 

Theorem 3.2. Suppose that P'-'^) is the law of a finite state stationary (real) 
Markov chain with transition matrix 



=Id+7V-^(Q-Id), 
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where Q is another irreducible transition matrix on the same state space. If /i is 
the invariant distribution ofQ, then it also the invariant distribution of Q^^\ 
and 

EWFAr(/3, h) h) = {F{h + Pu^)) 

Suppose that the states of lo are xi < X2 < ■ ■ ■ < Xn- What the last resuh 
tehs us is that for /3 > fixed, there is a phase transition (in the sense that 
the free energy is not analytic) at the points — /3.t„ < — /3.t„_i < . . . < —/Sxi. 
If /i < -I3x„ then F{l3, h) = and if -^x, < h < -/3xi_i then F{/3, h) = 
finF{h + (3xn) + . . . + ^i+iF{h + f3xi+i) + HiF{h + fixi). Therefore, one obtains 
a phase diagram with a multistep depinning transition. 
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